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TITLE OF THE INVENTION 

IMAGE PROCESSING APPARATUS AND METHOD, PROGRAM, AND 

STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image processing apparatus 
and method for converting the gradation of an image, and to a program and a 
storage medium for realizing such an apparatus and method. 
Description of the Related Art 

[0002] Histogram equalization is known as a conventional method for 
emphasizing the contrast of an entire image. In this method, a gradation 
conversion function is determined so that the distribution of a histogram 
after performing gradation conversion is flat (uniform) (For a detaxled 
algorithm, refer to "Digital Image Processing: by Rosenfeld and Kak, 
translated by Makoto Nagao"). 

[0003] An automatic gradation conversion apparatus utilizing histogram 
equalization has been disclosed in Japanese Patent Publication No. 2808773. 
The gradation conversion function is also called a gradation conversxon curve. 
In actual gradation conversion, a look-up table conforming to the gradatxon 
conversion function is mostly used. 

[0004] Conventionally, X-ray images have been mainly film images. 
Recently, however, the use of digital X-ray images obtained by digital X-ray 
photographing systems using a large area sensor, CR systems usxng 



stimulable phosphors, or the like is in progress. In such X-ray digital images, 
doctors tend to desire images equivalent to film images because they are 
accustomed to diagnose using conventional film images. Accordingly, an 
image equivalent to a film image has been obtained by performing gradation 
5 conversion processing using the characteristic curve of a film as a gradation 
curve. 

[0005] However, in gradation conversion processing according to 

histogram equalization, the gradation curve is determined only by flattening 
of the histogram of an image after conversion. Accordingly, the smoothness of 
10 the gradation curve is not guaranteed. As a result, an X-ray digital image 
frequently becomes an image different from that of a conventional film image. 
Such an image is difficult for doctors, accustomed to diagnose using 
conventional film images, to perform exact diagnosis. 
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SUMMARY OF THE INVENTION 



[0006] The present invention has been made in consideration of the 
above -described problems. 

[0007] It is an object of the present invention to provide an image 
processing apparatus and method capable of performing gradation 
conversion in which the flatness of a pixel-value histogram of an image after 
gradation conversion is excellent, and a program and a storage medium for 
realizing such a method. 

[0008] According to the present invention, the foregoing object is attained 
25 by providing an image processing apparatus for performing gradatron 
conversion processing for an object image, inclnding determination means for 



determining variables for specifying a gradation conversion function, from a 
relationship between the variables and a processed image obtained by 
performing gradation conversion processing for the object image with the 
gradation conversion function, and gradation conversion means for 
5 performing gradation conversion processing for the object image with the 
gradation conversion function specified by the variables determined by the 
determination means. 

[0009] Further, the foregoing object is also attained by providing an 
image processing method for performing gradation conversion processing for 
10 an object image, including a determination step of determining variables for 
specifying a gradation conversion function, from a relationship between the 
variables and a processed image obtained by performing gradatxon 
conversion processing for the object image with the gradation conversion 
function, and a gradation conversion step of performing gradation conversion 
15 processing for the object image with the gradation conversion functxon 
specified by the variables determined in the determination step. 
[0010] According to another aspect, the present invention relates to a 
computer readable storage medium storing a program for causing a computer 
to realize the functions of the above-described image processing apparatus. 
20 [0011] According to still another aspect, the present invention relates to a 
program for causing a computer to execute the steps of the above-described 
image processing method. 

[0012] According to yet another aspect, the present invention relates to a 
computer readable storage medium storing a program for causing a computer 
25 to execute the steps of the above-described image processing method. 

[0013] Other objects, features and advantages of the present invention 



will be apparent from the following descriptions taken in conjunction with 
the accompanying drawings, in which like reference numerals designate the 
same or similar parts through the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] The accompanying drawings, which are incorporated in and 
constitute a part of the specification, illustrate embodiments of the invention 
and, together with the descriptions, serve to explain the principle of the 
invention. 

[0015] FIG. 1 is a schematic diagram illustrating the entire configuration 
of a radiation-image processing system utilizing an image processing 
apparatus according to an embodiment of the present invention; 
[0016] FIG. 2 schematically illustrates gradation conversion processing 
according to the embodiment; 

[0017] FIGS. 3, 4, 5 are graphs, each illustrating a gradation curve 
applicable to the embodiment; 

[0018] FIG. 6 is a diagram illustrating the configuration of an image 
processing unit shown in FIG. l; and 

[0019] FIG. 7 is a flowchart illustrating an image processing method 
according to the embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0020] A preferred embodiment of the present invention will now be 
described in detail with reference to the accompanying drawings. 



[0021] FIG. 1 is a schematic diagram illustrating the entire configuration 
of a radiation-image processing system utilizing an image processing 
apparatus according to the embodiment. 

[0022] As indicated within a region surrounded by a one-dot chain line in 
FIG. 1, the image processing apparatus of the embodiment includes an image 
input unit 5, an X-ray photographing system control unit 6, an image 
processing unit 7, and an image storage unit 8. X rays generated by an X-ray 
source 3 controlled by an X-ray generation apparatus control unit 4 are 
detected by an X-ray sensor 1 after passing through a patient 2. The detected 
X rays are input to the image input unit 5 as a digital X-ray image. The input 
digital X-ray image is subjected to image processing, such as X-ray-sensor 
correction processing, gradation processing, spatial filtering processing, and 
the like, by the image processing unit 7. The digital X-ray image subjected to 
the image processing is displayed on a diagnosis monitor 9, stored in the 
image storage unit 8, or output to a printer 12, a diagnosis work station 13 or 
an image database 14 via a network 11. When the displayed or output image 
is unsatisfactory, image processing and display are repeated, for example, by 
changing an image processing parameter. The above-described operations are 
performed through an operation unit 10. 

[0023] FIG. 2 schematically illustrates an example of gradation 

conversion processing operating in this embodiment. A histogram H(x) 15 is a 
histogram of an image before being subjected to gradation conversion 
processing. A histogram H'(x) 17 is a histogram of a converted image obtained 
by performing gradation conversion processing with a gradation curve fix) 16 
for the image having the histogram H(x) 15. When the histogram H'(x) 17 is 
entirely flat (uniform), the number of pixels having each pixel value is an 



average number of pixels obtained by dividing the number of pixels of the 
entire image by the number of pixel values that the image can have. In this 
embodiment, a means square error between a case in which the histogram is 
completely uniform and the histogram H'(x) 17 is obtained, and the obtained 
5 value is used as an evaluation reference for the flatness of the pixel-value 
histogram of the image after gradation conversion. The evaluation reference 
for the flatness is not limited to the mean square error. Any other appropriate 
reference may be used, provided that it operates as a criterion for the amount 
of deviation between the pixel-value histogram of an image after gradation 
10 conversion and a flat pixel- value histogram. As the amount of deviation 
becomes smaller, the flatness becomes superior. 

[0024] That is, while providing a restriction condition so as to be 
equivalent to the characteristic curve of a film, the gradation curve fix) 16 in 
which the evaluation reference represented by the mean square error is 

1 5 minimized is obtained. This operation wiU now be more specifically described. 
[0025] First, a pixel value of a digital image is represented by x i. If the 
number of levels that pixel values can have is represented by M, % 1 ^ % i 
^ % M. For example, in the case of an image having 12-bit pixel values, M = 
4,096, x 1 = 0, and % M = 4,095. In the case of an image having 10-bit pixel 

20 values, M = 1,024, % 1 = 0, and %M = 1,023. The histogram of the digital 
image is represented by H ( % i). 

[0026] A gradation curve (gradation conversion function) is represented 
by f ( x i ; ai, a 2 , — , a N ), which is a function defined by N parameters 
(variables) ai, a 2( — , a N . That is, the gradation conversion characteristic of 
25 the gradation conversion function f is specified by the values of the N 
variables. The following Equation 1 expresses a sigmoid function that is a 



function representing a gradation curve equivalent to the characteristic curve 
of a film - 

f ( x ■ ai, a 2) a 3 , a 4) a 5 ) = as/(l + e-** x " a2) ) + a 4 - (Equation l). 
[0027] In this function, if (ax, a 2 , a 3 , a* a N ) = (1, 5, 3, 0.2, 1/102.4), a graph 
5 shown in FIG. 3 in which a 10-bit image is assumed is obtained. If (ai, a 2 , a 3 , 
84. an) = (2, 5, 3, 0.2, 1/102.4), a graph shown in FIG. 4 in which the contrast 
of the graph shown in FIG. 3 is doubled is obtained. 

[0028] Although this function can only provide an S-shaped curve having 
symmetrical contrast, an S-shaped curve having asymmetrical contrast can 
10 be realized by a function expressed by the following equation". 

f ( x ■■ ai, a 2 , as, a* a 5 , ae, a 7 , as, a 9 ) = as X ((1/(1 + e ^* * • a2 )) + 
a 7 /(l + e a3(a6 x x " a4) )) + a9 " " " (Equation 2) . 

[0029] In this function, if (ai, a 2 , as. a 4 , as, ae, a 7 , as, a 9 ) = (1, 5, 2, 7, 1/102.4, 
1/102.4, 1, 1.5, 0.2), a graph shown in FIG. 5 is obtained. Such a curve is used 
15 for a chest portion in order to provide a large contrast for a lung portion 
having high pixel values and a small contrast at a mediastinum having low 
pixel values. In FIG. 5, the ordinate represents density as in the case of the 
characteristic curve of a film. 

[0030] By thus defining the function of the gradation curve and changing 
20 parameters, a gradation curve corresponding to each type of film can be 
obtained. The histogram of a digital image (in which each pixel value is the 
function of oi. a* ~. an) after being converted with the above-described 
gradation curve f ( x : ax, a 2 , -, a N ) is represented by ff( x 0. The ff ( x 0 can 
be expressed by H'(f ( x i- ai, a 2 , — , a N ). 
25 [0031] The sum Ie of square errors between the H'( x i) and a histogram 
H"(xi) = m (m is the average number of pixels) that is uniform over the 
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entire pixel values is obtained. Ie is the function of the parameters of a 
gradation-curve function expressed by the following equation: 
Ie ( ai , a 2 , -, a N ) = | lm-H'(%i)l 2 = 

| |m-H'(f(xi:a 1 ,a 2) -,aN))l 2 -(Equations). 

5 [0032] The parameters are determined so as to minimize the sum Ie of 
square errors. If equivalence to the characteristic curve of a film is 
maintained even if these parameters are handled as parameters not having 
limitations, simultaneous equations as expressed by the following Equation 4 
in which partial differentiation of each of parameters ai, a 2 , ™, a N in the 
10 Ie (ai, a 2) ~, a N ) is set to 0 are obtained. By solving these equations, the 
parameters ai, a 2 , — , a N can be obtained. 
d Ie (ai, a 2 , — , an)/ d ai = 0 
die (ai, a 2 , — , an)/ d a 2 = 0 



15 

d Ie (ai, a 2 , — , an)/ d an = 0 

— (Equation 4). 

[0033] In a gradation curve f ( x • ai, a 2 , -, a N ) using the parameters ax, a 2 , 
20 -, a N obtained by solving these simultaneous equations, uniformity of a 
histogram after conversion is maximized while maintaining equivalency to a 
film. Then, gradation conversion of image information input to the image 
input unit 5 is performed based on the gradation curve f (% : ai, a* ™. an) 
using the parameters ax, a 2 , ~. aw obtained by solving the above-described 
25 simultaneous equations, and resultant data is output from information 
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output means, such as the diagnosis monitor 9 or the like. 
[0034] In a simple example of a case in which equivalency to the 
characteristic curve of a film is not maintained if limitation is not provided 
for parameters, specific parameters are handled as parameters not having 
5 limitation, and other parameters are fixed with constants. For example, in 
Equation 1, only parameters ai and a 2 are handled as variables, and other 
parameters a 3 , a 4 and a 5 are fixed. It is thereby possible to change contrast or 
perform shift in a lateral direction while maintaining an S-shaped curve, as 
shown in FIG. 3 or FIG. 4. 
10 [0035] In this case, Ie is the function of ai and a 2> and ai and a 2 can be 
obtained by solving simultaneous equations in which the Ie is partially 
differentiated by ai and a 2 . Various further complicated restriction conditions 
for parameters can be considered. When intending to perform optimization in 
such restriction conditions, for example, refer to "Optimization by Vector 
15 Space Methods: by David G. Luenberger, translated by Masami Masubuchi 
and Hideaki Kano, published by Corona Sha" that describes various methods, 
such as a method using Lagrange's multipliers, a method in the case of 
inequality restriction conditions, and the like. The parameters may be 
optimized by using one of these methods. 
20 [0036] For example, the above-described gradation conversion processing 
can be realized by configuring the image processing unit 7 as shown in FIG. 6. 
In FIG. 6, the image processing unit 7 includes a CPU (central processing 
unit) 60 for controlling the entire image processing unit 7, a RAM (random 
access memory) 61, serving as storage means for storing programs, data, 
25 object images and the like necessary for operations of the CPU 60, an image 
conversion unit 62 for performing gradation conversion of an object image 
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with the gradation conversion function f (x- ai, a 2 , -, a N ), a histogram 
formation unit 63 for forming a pixel-value histogram H'(%i) expressed by 
variables obtained by the image conversion unit 62, a 
gradation-conversion-LUT forming unit (gradation-conversion-function 
setting unit) for forming a gradation conversion look-up table (LUT) by 
obtaining variables ai, a* -, a N for minimizing square errors between the 
pixel-value histogram H'(%i) obtained by the histogram formation unit 63 
and a flat histogram H"(%i) = m, and a gradation conversion unit 65 for 
performing gradation conversion of an object image using the gradation 
conversion LUT obtained by the gradation-conversion-LUT forming unit 64. 
A CPU bus 66 interconnects the respective units 60 - 65 so as to be able to 
perform communication. 

[0037] The respective units 62 - 65 may be configured, for example, using 
integrated circuits or the like. The functions of the respective units 62 - 65 
may also be realized by executing predetermined programs stored in the 
RAM 61 or the like by the CPU 60. In this case, the programs may include 
program codes corresponding, for example, to an image processing method 
shown in the flowchart of FIG. 7. 

[0038] Next, the image processing method will be described with respect 
to FIG. 7. First, by performing gradation conversion of an object image with 
the gradation conversion function f ( x • ai. a 2 , - f a N ), an image having pixel 
values represented by predetermined variables is obtained (image conversion 
step S70). Then, the pixel-value histogram H'(%0 of the image represented 
by the variables is formed (histogram forming processing S7l). Then, the 
values of variables ai, a* ~. a N for minimizing square errors between the 
pixel-value histogram H'( x 0 obtained in the preceding step and a flat 
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histogram H»< % i) = m is obtained, and a gradation conversion LUT is formed 
(gradation-conversion-LUT forming step S72). Then, the object image xs 
subjected to gradation conversion using the gradation conversion LUT 
obtained in the preceding step (gradation conversion step S73). 
5 [0039] According to the above-described embodiment, since it is possible 
to perform gradation conversion so as to provide picture quality equivalent to 
a film, and realize gradation conversion in which contrast is effectively 
allocated so that a histogram after conversion is as uniform as possible, the 
diagnosis capability can be improved by providing a doctor with an image 
10 obtained by this gradation conversion. 

[0040] The object of the present invention may also be achieved by 
supplying a computer (a CPU or an MPU (microprocessor unit)) within an 
apparatus or a system connected to various devices with program codes of 
software, and realizing the functions of the above-described embodiment by 
15 operating the various devices in accordance with the supplied program by the 
computer of the system or the apparatus. 

[0041] In such a case, the program codes themselves of the software 
realize the functions of the above-described embodiment, so that the program 
codes themselves constitute the present invention. A computer network (a 

20 LAN (local area network), a WAN (wide area network), such as Internet or 
the like, a radio communication network, or the like) for transmitting and 
supplying program information as a predetermined signal, or a 
communication medium in the system (a wire network, for example, usxng 
optical fibers, a radio network, or the like) may be used as a medium for 

25 supplying the program codes. 

[0042] Furthermore, means for supplying a computer with the program 
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codes, such as a storage medium storing the program codes, constitutes the 
present invention. For example, a flexible disk, a hard disk, an optical dtsk, a 
m agnetoo P tical disk, a CDfcompact discVROM (read-only memory) a 
magnetic tape, a nonvolatile memory card, a ROM or the like may be used as 
5 the storage medium storing the program codes. 

10043] Not only in a case in which the functions of the abovedesermed 
embodiment are realized by executing the supplied program codes by a 
computer, hut also in a case in which the functions of the above descrtbed 
etnbodiment are realized by cooperation of the program codes wtth an OS 
10 (operating system) operating in a computer, other application software or the 
like the program codes, of course, constitute the present inventton. 
[0044] In a case in which after storing supplied program codes mto a 
m emory provided in a function expanding beard of a computer or m a 
function expanding unit connected to the computer, a CPU or the hke 
15 provided in the function expanding board or the function expanding - 
performs a part or the entirety of actual processing, and the functions of the 
above-described embodiment are realized by the processing, the program 
codes, of course, constitutes the present invention. 

[0045) The present invention may also be applied to a system includmg a 
20 Plurality of apparatuses (e.g., radiation generating apparatuses, radiography 
apparatuses, image processing apparatuses, interface apparatuses, and the 
Uke) and to a single apparatus in which the functions of these apparatuses 
are integrated. When the present invention is applied to a system includmg a 
plurality of apparatuses, the apparatuses communicate with one another vta, 
25 for example, electrical, optical, and/or mechanical means, and/or the hke. 

[0046] Furthermore, the present invention may also be applied to an 
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image diagnosis aiding system including a network (LAN and/or WAN, or the 
like). 

[0047] The present invention thus achieves the above-described object as 
described above. 

5 [0048] The individual components designated by blocks in the drawings 
are all well known in the image processing apparatus and method arts and 
their specific construction and operation are not critical to the operation or 
the best mode for carrying out the invention. 

[0049] While the present invention has been described with respect to 
10 what are presently considered to be the preferred embodiments, it is to be 
understood that the invention is not limited to the disclosed embodiments. To 
the contrary, the present invention is intended to cover various modifications 
and equivalent arrangements included within the spirit and scope of the 
appended claims. The scope of the following claims is to be accorded the 
15 broadest interpretation so as to encompass all such modifications and 
equivalent structures and functions. 
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